4.4 Testing with Nuisance Parameters

1 Nuisance Parameters

Sometimes there are extra unknown parameters which we are not of direct interest. Like for P={Pθ,λ|(θ,λ)∈Λ}, we test H0:θ∈Θ0 vs H1:θ∈Θ1, here θ is parameter of interest, and λ is nuisance parameter.
The issue is that λ is unknown, but might affect Type I error or power of a given test.

2 UMPU Multivariate Tests

2.1 Multiparameter Exponential Families

Assume X∼pθ,λ=eθTT(x)+λTU(x)−A(θ,λ)h(x), where θ∈Rs,λ∈Rr are both unknown. How to test H0:θ∈Θ0 vs H1:θ∈Θ1?
The idea is to condition on U(X) to eliminate dependence on λ.

  1. Sufficiency reduction:
    Let (T(X),U(X))∼qθ,λ(t,u)=eθTt+λTu−A(θ,λ)g(t,u), here gdtdu is the push-forward of hdμ.
  2. Condition on U(X): qθ(t|u)=qθ,λ(t,u)∫qθ,λ(z,u)dz=eθTt+λTu−A(θ,λ)g(t,u)∫eθTz+λTu−A(θ,λ)g(z,u)dz=eθTtg(t,u)∫eθTzg(z,u)dz=eθTt−Bu(θ)g(t,u).
  3. Conditional test: test H0:θ∈Θ0 vs H1:θ∈Θ1 in s− parameter model Qu={qθ(t|u):θ∈Θ}.

If s=1, this family has MLR in T. Even if s>1, we still have gotten rid of λ.

2.2 UMPU for Multi Exponential Families

Theorem

Let P be full rank exponential family with densities pθ,λ(x)=eθT(x)+λTU(x)−A(θ,λ)h(x), θ∈R,λ∈Rr,(θ,λ)∈Ω open.

  1. To test H0:θ≤θ0 vs H1:θ>θ0, there is a UMPU test ϕ∗(x)=ψ(T(x);U(x)), where ψ(t;u)={1,t>c(u),γ(u),t=c(u),0,t<c(u), where c(u),γ(u) are chosen to make Eθ0[ϕ∗(X)|U(X)=u]=α.
  2. To test H0:θ=θ0 vs H1:θ≠θ0, there is a UMPU test ϕ∗(x)=ψ(T(x);U(x)), where ψ(t;u)={1,t<c1(u) or t>c2(u),γ(u),t=ci(u),0,c1(u)<t<c2(u), where c(u),γ(u) are chosen to make Eθ0[ϕ∗(X)|U(X)=u]=α,Eθ0[T(X)(ϕ∗(X)−α)|U(X)=u]=0.

Note that λ has disappeared from the problem.

The above example rejects for

This is equivalent to reject for marginally extreme T=nX―S2, where S2=1n−1∑i=1n(Xi−X―)2=1n−1(∑i=1nXi2−2X―∑i=1nXi+nX―2)=1n−1(||X||2−nX―2), so T=n−1nX―||X||2−nX―2=n−1R1−R2 for R=nX―||X||=1n1nTX||X||=cos⁡⟨1n,X⟩.
Geometrically, T=nX―S2=||Proj1nX||||Proj1n⊥X||n−1sgn(X―).
Pasted image 20241214145313.png|400

3 Permutation Test

Even if we don't get a UMPU test at the end, conditioning on null sufficient statistics still helps.